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PRIORITY 

[0001] This application claims priority from the U.S. Provisional Patent Application No. 
60/281637, entitled Integrated Automated and Live Electronic Customer Service 
Application and Method, filed on April 5, 2001. 

RELATED APPLICATIONS 

[0002] This application is related to the following commonly owned and assigned U.S. 
Patents, all of which are expressly incorporated herein by reference: 

6,201,948, entitled Agent Based Instruction System and Method; and 
5,727,950, entitled Agent Based Instruction System and Method. 

FIELD OF THE INVENTION 

[0003] The present invention relates to automated, end-user support systems. In 
particular, but not by way of limitation, the present invention relates to systems and 
methods for integrating live end-user support with automated support. 

BACKGROUND OF THE INVENTION 

[0004] The Internet and ecommerce Web sites are radically altering the way that many 
businesses operate. In particular, ecommerce Web sites are altering the relationship 
between buyers and sellers. Sellers, for example, can realize substantial cost savings by 
moving buyers from their brick-and-mortar stores to their ecommerce Web sites. 
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Unfortunately, the full potential of these ecommerce Web sites is not being realized 
because of poor customer experiences while using them. 

[0005] Statistics show that the majority of sales initiated on an ecommerce Web site are 
abandoned before completion. Often these transactions are abandoned because the 
customer has reached some impasse such as a site navigation problem or an unanswered 
product question. Some businesses address these customer issues by providing live 
customer support. Live customer support, however, is relatively expensive and, thus, 
negates much of the cost savings offered by ecommerce. Additionally, when live 
customer support only provides for email response, customers often abandon transactions 
before receiving an email response. 

[0006] Because live customer support is relatively expensive, many businesses elect to 
use online, non-live support either exclusively or in conjunction with some type of live 
help. Most of these types of non-live support systems are form-based instruction 
manuals. In other words, the customer is given a list of frequently asked questions 
(FAQs) from which to select. Assuming that the customer's question is in the list of 
FAQs, these types of support systems return the corresponding answer in a text-based 
format. Rather than navigate such an instruction manual, many users simply terminate 
the transaction or contact the live customer support. In either case, the business 
associated with the ecommerce Web site loses important revenue. 

[0007] Some non-live support systems attempt to present an animated character to 
address the customers issues. These characters are generally little more than animated 
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instruction manuals and lack the "look and feel" of live help. Again, rather than deal with 
such an annoying and unhelpful character, many customers terminate the transaction or 
contact live customer support. Moreover, these present systems are generally rigid and 
typically cannot be easily transported from one ecommerce site to another. Thus, these 
present non-live systems are not only unsatisfactory from the customer's perspective, they 
are expensive to develop and modify from the ecommerce business's perspective. 

[0008] As ecommerce becomes more competitive, successful businesses will retain a 
higher percentage of customers while spending a minimum amount of money on 
customer support. Businesses are losing precious revenues because present technologies 
do not sufficiently minimize customer support costs while retaining customers. 
Accordingly, a system and method are needed to address the above-mentioned and other 
shortfalls in present technology. 

SUMMARY OF THE INVENTION 

[0009] Exemplary embodiments of the present invention that are shown in the drawings 
are summarized below. These and other embodiments are more fully described in the 
Detailed Description section. It is to be understood, however, that there is no intention to 
limit the invention to the forms described in this Summary of the Invention or in the 
Detailed Description. One skilled in the art can recognize that there are numerous 
modifications, equivalents and alternative constructions that fall within the spirit and 
scope of the invention as expressed in the claims. 
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[0010] In one embodiment, the present invention, provides a system and method for 
integrating an intelligent, automated support system with a live support system to thereby 
provide economical end-user support. For example, such a system could include a live 
support system, an automated support server, and a knowledge database. Other 
implementations can also include report modules and data collection modules. 

[0011] In one implementation, the automated support server can provide both just-in- 
time help and/or cobrowsing through an automated agent that is displayed in the end- 
user's browser window. (Note that the end-user can include both customers and any other 
type of user.) The just-in-time help is initiated by the end-user and is used to address a 
particular problem that the end-user might have. For example, as an end-user navigates a 
Web site, questions may arise regarding a product. The end-user can activate the 
automated agent associated with the Web site to find an answer to that question. Once 
the automated agent has answered the question, the automated agent can be terminated. 

[0012] Alternatively, the automated agent can cobrowse with the end-user. In this 
cobrowsing implementation, the automated agent does not merely answer a question and 
then go away. Rather, in a cobrowsing situation, the automated agent is persistently with 
the end-user while the end-user navigates the corresponding Web site. For example, the 
automated agent could cobrowse with the end-user to aid the end-user in configuring a 
new computer. The automated agent would collect information regarding the intended 
uses for the computer, budget constraints, and other helpful information and would make 
recommendations based upon that collected information. When the end-user selects a 
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particular monitor, for example, the cobrowsing automated agent can automatically 
recommend an appropriate driver card or recommend a different monitor that better 
addresses the end-user's needs. 



[0013] Whether operating in just-in-time mode or in cobrowsing mode, the automated 
agent can be configured to receive data from the end-user and to respond accordingly. In 
other words, the automated agent can behave much like a live agent. To simulate a live 
agent, the automated agent can assume one of a series of roles. For example, the 
automated agent could be assigned a greeting role, an orientation role, a customer support 

C3 

W role, a process accompaniment role, etc. These roles are reusable units that define the 

vS 

'5 goal of the automated agent and the bounds of its behavior. 
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^ [0014] Each role can include a set of skills that manage the exchange of data between the 

p end-user and the automated agent. Skills can be separated into two categories: social 

CO 

hi skills and input/output (I/O) control. Social skills provide the automated agent with life- 

t 

l-J like characteristics such as speech, gestures, mannerisms, memory and movements. The 

I/O control provides the automated agent with the ability to retrieve data responsive to 
actions by the end-user, manipulate that data as needed and provide it to the end-user in a 
usable form. For example, the automated agent could include an order-status-retrieval 
skill that retrieves order-status data from a shipping database responsive to a request from 
the end-user and informs the end-user of the relevant order status. 



[0015] Based upon input from the end-user, an appropriate skill associated with the 
automated agent can also access a knowledge database and determine a response that 
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addresses the end-user ? s question. The appropriate response may include a single step of 
providing an answer to a frequently asked question or it may include a multi-step, multi- 
branch action that guides the end-user through a series of actions. For example, if the 
end-user needs help in configuring a new computer, the knowledge database may contain 
a configuration tree of all the possible configurations. As the end-user selects one option, 
the automated agent, through a configuration skill, can navigate the tree to present the 
end-user with the next set of options. Based upon the end-user's intended uses and/or 
budget, the automated agent can identify preferred options within each set of options. 

[0016] In one embodiment, when the automated agent cannot address the end-user's 
questions or when alternative support is more appropriate, an alternative support session, 
e.g., a live support session, a prerecorded support session, an email response, a chat 
session, etc., can be initiated either by the automated agent or by the end-user. Any data 
collected or used by the automated agent can be passed, for example, to the live agent, 
thereby providing a somewhat seamless transition from the automated agent to the live 
agent. Additionally, the automated agent can pass to the live agent any data related to the 
automated agent's attempts to address the end-user's questions. 

[0017] After the live agent has addressed the end-user's questions, the live agent can 
pass the end-user back to the automated agent. Just as if the automated agent were a live 
agent, the automated agent can remember the end-user and the end-user's previous 
support sessions. In certain embodiments, the automated agent is even aware of the 
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actions that the live agent initiated to address the end-user's questions, thereby allowing 
the automated agent to resume a support session at the proper point. 

[0018] In one implementation, questions addressed by the live agents are recorded and 
used to improve the knowledge database so that the automated agent can address those 
issues in the future without the aid of a live agent. For example, if a particular question is 
repeatedly referred from the automated agent to the live agents, that question and 
corresponding answer can be added to the knowledge database. The next time that the 
automated agent is presented with that question, it can retrieve the proper answer from 
the knowledge database and not involve the live agent. Alternatively, if that question and 
answer are already in the knowledge database, the placement of that question relative to 
other issues addressed by the automated agent can be changed. For example, the question 
and answer can be added to a list of frequently asked questions that is presented 
immediately by the automated agent. 

[0019] Although the present invention is generally described with regard to product sales, 
it should not be limited thereto. The end-user support described above can be used in 
virtually any industry. For example, the automated agent could be used by the financial 
industry, the service industry, and the like. Moreover, the automated agent need not be 
Web based. In some embodiments, the automated agent is loaded directly onto an end- 
user's computer. From there, the automated agent can, for example, troubleshoot 
software and hardware issues. 
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[0020] As previously stated, the above-described embodiments and implementations are 
for illustration purposes only. Numerous other embodiments, implementations, and 
details of the invention are easily recognized by those of skill in the art from the 
following descriptions and claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0021] Various objects and advantages and a more complete understanding of the present 
invention are apparent and more readily appreciated by reference to the following 
Detailed Description and to the appended claims when taken in conjunction with the 
accompanying Drawings wherein: * 

FIGURE 1 illustrates a system constructed in accordance with an embodiment of 
the present invention; 

FIGURE 2 illustrates an alternate system also constructed in accordance with an 
embodiment of the present invention; 

FIGURE 3 is a flowchart showing one method of operating the system shown in 
FIGURE 2; 

FIGURE 4 illustrates yet another system constructed in accordance with an 
embodiment of the present invention; 

FIGURE 5 is a flowchart showing one method of operating the system shown in 
FIGURE 4; 
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FIGURE 6 illustrates the interaction of the annotation server and the browser; and 
FIGURE 7 is a flowchart showing one method of operating the annotation server. 
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DETAILED DESCRIPTION 

[0022] Referring now to the drawings, where like or similar elements are designated with 
identical reference numerals throughout the several views, and referring in particular to 
FIGURE 1, there is illustrated a system 100 constructed in accordance with the principles 
of the present invention. This system 100 includes a plurality of end-users 105 connected 
through a network 1 10, such as the Internet, to a content provider 115, such as an 
ecommerce Web site. Any of the end-users 105 can access the content provider 115 
through the network 110, and when necessary, an end-user 105 can also access an 
automated support server 120 for support. In one implementation, automated support 120 
is manifested by an automated agent that is displayed in the end-user's browser window 
in conjunction with content from the content provider 115. 

[0023] The automated agent is preferably generated by the automated support server 120 
and is generally aware of the end-user ! s personal information, metadata associated with 
the content provider 1 15, the end-user r s navigation location within a Web site, and 
navigation events initiated by the end-user 105. For example, if the end-user 115 follows 
a particular link in a Web page provided by the content provider 115, the automated 
agent- via the automated support server 120—can be aware of that fact and can also be 
aware of the next page from the content provider 1 1 5 that will be displayed for the end- 
user 105. Through this awareness of navigation events, the automated agent provides the 
end-user with an interactive and intelligent support session rather than just a list of 
questions and answers. 
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[0024] To generate the automated agent and to drive its interaction with the end-user 105, 
the automated support server 120 can use information stored in the knowledge database 
125. This information can include data about the end-user 105, predefined character 
traits of the automated agent, and/or interaction management data. Further, this type of 
information can include role definitions and skill definitions. For example, the automated 
agent can be associated with a particular role such as greeter, product advisor, process 
accompaniment, customer service, etc., that define the boundaries of the automated 
agent's behavior. Each of these roles includes a possibly distinct set of skills that manage 
the automated agent's interaction with the end-user 105. One set of skills might define 
the social aspects of the automated agent and another set of skills might manage the flow 
of data between the automated agent, the knowledge database 125, and the end-user 105. 
For example, a "get order status" skill could retrieve order information from the end-user 
105, pass that information to the knowledge database 125, receive corresponding order 
status information from the knowledge database 125, and provide that order status 
information to the end-user 105. 

[0025] If the end-user 105 needs additional help or if the automated agent determines that 
an alternative support session is necessary or would be beneficial, the automated agent 
can automatically escalate the help session to involve, for example, live agents at a call 
center 1 30 or at any other location. The live support session could be conducted through 
the live support server 135 with video and/or audio streaming, chat sessions, Voice-over- 
IP channels, and/or email. The live support sessions can also be conducted through a 
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traditional phone call routed to the call center 130 through, for example, a public switch 
telephone network (PSTN) 140. 

[0026] When a live help session is initiated, the live agent can access the knowledge 
database 125 and/or the automated support server 120 to collect data about the end-user 
105 and the end-user's session with the automated support server 120. Accordingly, the 
transition from the automated agent to the live agent can be somewhat seamless. 
Additionally, the live agent can work in conjunction with the automated agent to address 
the end-user ? s questions. In this implementation, the automated agent could run in the 
background and not be visible to the end-user 105. Even though it is not necessarily 
visible, the automated agent can gather information, for example, about the end-user's 
present location within a Web page and subsequent navigation events. This information 
can be passed to the live agent to provide a more complete understanding of the end- 
user's situation. 

[0027] Additionally, once the live agent has addressed the end-user's question, the end- 
user 105 can be passed back to the automated agent, i.e., the automated support server 
120. The automated agent can remember the end-user's previous session and interact 
with the end-user 105 accordingly. In some implementations, the automated agent can 
even be provided with details related to the end-user's interaction with the live agent. 
Thus, the transition from the live agent back to the automated agent could appear 
virtually seamless to the end-user 105. 
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[0028] To improve the responsiveness of the automated agent, details regarding end- 
users' sessions can be logged and analyzed. In particular, the details regarding the 
interaction between live agents and end-users 105 can be logged and analyzed. For 
example, when the automated agent refers an end-user 105 to a live agent, the question 
raised by the end-user 105 can be recorded. This question and a corresponding answer 
can then be added to the knowledge database 125 so that the automated agent can answer 
the question in the future without the aid of a live agent. In other implementations, an 
event record is created when an end-user 105 terminates the automated agent before the 
end-user ? s question is addressed. These event records can be aggregated to determine if 
the automated agent is being unresponsive and to determine what updates should be made 
to the knowledge database 125 or to the automated support server 120. 

[0029] Referring now to FIGURE 2, it illustrates another implementation of a system 145 
constructed in accordance with the principles of the present invention. In this system 
145, an end-user 105 can connect either to the live support system 135 (could also 
connect to the call center 130) or to the automated support server 120. Both systems 120 
and 135 have access to the knowledge database, which as previously described, can 
contain information about the content provider's Web site, the end-user 105, and/or 
interaction management instructions. Thus, both the live support system 135 and the 
automated support system 120 have access to similar information when addressing an 
end-user's questions. For example, a live agent— through the live support system 135— 
could access the same set of interaction management instructions to address an end-user's 
question as would the automated agent-through the automated support server 120. 
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Although the knowledge database 125 is shown as a single element, those of skill in the 
art can understand that the knowledge database 125 can be arranged in a variety of ways 
including a multi-device, distributed storage system and a multi-device independent 
storage system. 

[0030] As (or after) the end-user 105 interacts with the live support system 135, data 
regarding the interaction can be collected and recorded in the data collection module 150 
by the report and analysis module 155. This information can be analyzed to identify 
needed enhancements to the automated support server 155. For example, the report and 
analysis module 155 can determine that a new frequently asked question and its 
corresponding answer should be added to the knowledge database 125, thereby allowing 
the automated agent to answer that question without the aid of a live agent. In other 
implementations, the report and analysis module 155 can recommend enhancements to 
the live support system 135, network configurations, marketing tactics, automated agent 
presentations, etc. Additionally, the report and analysis module 155 can track usage of 
the automated support server 120 and/or live support system 135 for modeling and/or 
billing purposes. 

[0031] Referring now to FIGURE 3, it shows a method of operating the system 145 
shown in FIGURE 2. In this implementation, an end-user 105 is routed from the 
automated agent at the automated support server 120 to a live agent at the live support 
system 135 (step 160). The live support system 135 then accesses the knowledge 
database 125 and retrieves any information relating to the end-user 105, the user's 
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interaction with the automated agent, and/or the user's present location within the content 
provider's Web site (step 165). Alternatively, the automated support server 120 could 
initiate the transfer of this data to the live support system 135. In either case, the data 
available to the automated agent is generally available to the live agent. If not available 
in the retrieved information, the live agent determines the user's questions and addresses 
them according to either an interaction management plan—possibly stored in the 
knowledge database 125— or personal experience (step 170). 

[0032] The end-user's question, its answer, and any appropriate comments can then be 
recorded in the data collection module 150 (step 175). When a meaningful sample of 
questions has been collected, the report and analysis module 155 can retrieve necessary 
data from the data collection module 150 and determine if any of the questions being 
handled by the live support system 135 are better suited for the automated support server 
120 (step 180). If so, an update for the automated support server 120 is identified and 
implemented (step 185). Likewise, the report and analysis module can create an 
improved plan for live agents to address particular questions. 

[0033] Referring now to FIGURE 4, it illustrates an alternate implementation of a system 
190 constructed in accordance with the principles of the present invention. This 
embodiment includes a Web browser 195 (representing the end-user 105) connected to 
the content provider 115 and the automated support server 120. The browser 195 is also 
connected to an annotation server 120 that is responsible for masking addresses so that 
the automated agent and the content from the content provider 1 1 5 can appear 
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simultaneously within a single browser frame set and exchange information despite the 
fact that the automated agent and the content, from the content provider 115, originate 
from different domains. Moreover, the automated agent can manifest itself in the 
browser window using a variety of ways including a Java applet, a flash player, or 
traditional HTML techniques. 

[0034] Still referring to FIGURE 4, the automated support server 120 of this 
implementation includes three basic components: a platform 205, a profiler application 
210, and resource data 215. The automated support server 120 can be implemented on 
many types of hardware including Sun Microsystems based systems, Microsoft based 
systems, and Linux based systems. Additionally, the various components of the 
automated support server can be distributed across one or more hardware platforms or 
otherwise arranged in a distributed fashion. 

[0035] The profiler application 210 of the automated support server 120 includes a roles 
module 220, a skills module 225, and an interpreter module 230. The roles module 220 
includes reusable definitions for each role that an automated agent can be assigned. 
Similarly, the skills module 225 includes the definitions for each skill that can be 
assigned to a role. The interpreter module 230 is responsible for invoking the appropriate 
role and skill in response to end-user 105 initiated events. For example, the interpreter 
module 230 could initially invoke a greeting role for the automated agent and assign the 
appropriate skills to that role. 
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[0036] The actual character definitions, social rules, character dialogue, and other 
relevant data are contained in the resource data module 215, which generally corresponds 
to at least portions of the knowledge database 125 of FIGURE 1. To execute a particular 
skill, the platform 205 bridges between the profiler application and the resource data 
module 215 to retrieve the necessary data. For example, one dialogue contained in the 
resource data 215 could be called "formal greeting" and be associated with the phrase 
"Hello Sir, I will be your guide today," and another dialogue could be called "informal 
greeting" and be associated with the phrase "Let me show you around." The same role, 
"site orientation," and the same skill, "speak greeting," could invoke either dialogue 
based upon data about the end-user 105. In other words, if the end-user 105 is, for 
example, under 30 then the "speak greeting" skill could use the informal greeting. 
Otherwise the "speak greeting" skill could use the formal greeting. By modularizing the 
profiler application 210 and the resource data 215 in this way, the automated agent can be 
easily adapted to handle new roles, new skills, new dialogue, and new visual 
characteristics. Additionally, this type of modularization allows for an automated support 
server 120 to be quickly and efficiently customized for different content providers. 

[0037] Referring now to FIGURE 5, it is a flowchart of one method of operating the 
system shown in FIGURE 4. In this implementation, an end-user 105, through a browser 
190, requests and receives content from the content provider 115 (steps 230 and 235). 
This content generally includes a link-possibly in the form of an icon-to the automated 
agent. When in need of assistance, the end-user 105 selects the link to the automated 
agent, and, in response, the browser 195 sends a fetch request to the automated support 
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server 120 for the data associated with the automated agent (steps 240 and 245). Next, 
the automated support server 120 identifies the appropriate role for the automated agent 
and loads the skills associated with that role (steps 250 and 255). Next, the action item 
for the automated agent is identified (step 260). For example, the action item could be to 
invoke the "look busy" skill. The automated support server 120 can then use the action 
item, role, and/or skills to determine the proper animation for the automated agent and 
display the automated agent along with the proper animation on the browser window 
(steps 265 and 270). 

[0038] Additionally, the automated support server 120 can cause the content from the 
content provider 1 15 to be refreshed (step 275). However, to circumvent the consistent 
page domain security requirement, the annotation server 200 masks the content from the 
content provider 1 15 so that it appears to originate from the same domain as the 
automated agent (step 275). This masking process is described in greater detail with 
relation to FIGURE 6. 

[0039] In addition to displaying the automated agent alongside the content from the 
content provider 115, the automated support server 120 can also display a list of options 
on the browser window from which the end-user 105 can choose. Responsive to the end- 
user 105 choosing one of the listed options, the automated support server 120 can access 
the resource data 215 within the automated support server 120 and determine the proper 
response (steps 280 and 285). That response can be displayed in the browser window 
(step 290). 
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[0040] Referring now to FIGURE 6, it illustrates the interaction of the annotation server 
120 and the browser 195, which can communicate with each other, for example, through 
HTTP tunneling 295. In this embodiment, the browser 195 displays two frames: the 
automated support frame 300 and the content frame 305. Other frames could be used to 
display menus and/or dialogue associated with the automated agent. Separator 310 
represents the consistent page domain security requirement that prevents the free flow of 
data and event information between the two frames. 

[0041] By circumventing the consistent page domain security requirement, the annotation 
server 120 allows data to be exchanged by the frames even though they originate from 
different domains. (As previously described, the automated agent generally originates 
from the automated support server's domain and the content frame originates from the 
content provider's domain.) First, event information 315 can be passed from the content 
frame 305 to the automated agent frame 300. For example, if the end-user 105 selects a 
link being displayed in the content frame 305, corresponding event information 315 can 
be passed from the content frame 305 to the automated agent frame 300 where it is 
available to the annotation server 120 and the automated agent. Second, commands 320 
can be passed from the annotation server 120 to the content frame 305. For example, the 
automated agent (or live agent) can actively guide the end-user 105 by following links 
being displayed in the content frame 305. 

[0042] The role of the annotation server 120 in enabling these two types of data 
exchanges is illustrated by the flowchart in FIGURE 7. Initially, the end-user 105, 
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through the browser 195, activates the automated agent (step 330). Next, the annotation 
server 120 retrieves from the content provider 1 15 the page presently being displayed in 
the content frame 305 and identifies each link in that retrieved page (steps 335 and 340). 
The annotation server 120 encodes the identifier for the retrieved page and each link in 
the same domain as the retrieved page to appear as if they originate from the automated 
support server 120. In other words, the annotation server 120 encodes the links as if they 
originated from the same domain as the automated agent (step 345). Any "top" 
commands associated with the retrieved page are converted so that the automated agent 
frame 300 and the content frame 305 appear simultaneously within the browser window 
(steps 350 and 355). 

[0043] When the end-user 105 selects a link (step 360) within the content frame 305 the 
annotation server determines if the link is encoded (step 365). Assuming that the link 
was previously encoded, a corresponding fetch request 120 is sent to the annotation 
server 120 rather than to the content provider 115 (step 360). The annotation server 120 
then decodes (step 380) the link and forwards the fetch request to the content provider 
115. The content provider 115 returns the requested page to the annotation server 120 
(step 335), which encodes the identifier of the returned page and identifies and encodes 
the appropriate links in' the returned page (steps 340 and 345). When the end-user 105 
selects a link that was not previously encoded, the corresponding fetch request is routed 
according to the link and is not necessarily routed the annotation server 120 (step 370). 
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[0044] In an alternate embodiment, links associated with the automated agent and its 
menus can be encoded so that their domain matches the domain of the content from the 
content provider. Moreover, encoding can be avoided if the automated agent is hosted by 
the content provider. In such an implementation, both the automated agent and the 
content could originate from the same domain. 

[0045] In conclusion, the present system provides, among other things, a system and 
method for providing automated end-user support. Those skilled in the art, however, can 
readily recognize that numerous variations and substitutions may be made in the 
invention, its use and its configuration to achieve substantially the same results as 
achieved by the embodiments described herein. Accordingly, there is no intention to 
limit the invention to the disclosed exemplary forms. Many variations, modifications and 
alternative constructions fall within the scope and spirit of the disclosed invention as 
expressed in the claims. 
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